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1. Introduction 


Let X be a random variable having probability distribution P(X/0), 0 € ©. It 
is desired to test Hp : 0 € O against Hı : 0 € 08, = O — Op. Let S denote 
the sample space of outcomes of an experiment and x = (21, %2,...,%,) denote an 
arbitrary element of S. A test procedure consists in diving the sample space into 
two regions W and S — W and deciding to reject Ho if the observed x € W. The 
region W is called the critical region. The function 7(0) = Po(x € W) = Po(W), 
say, is called the power function of the test. 

We consider first the case where Op consists of a single element, 0) and its 
complement ©; also has a single element 0,. We want to test the simple hypothesis 
Ho : 0 = 4 against the simple alternative hypothesis Hı : 0 = 04. 
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Let Lo = L(X/Ho) and Ly = L(X/H;) be the likelihood functions under Ho 
and H; respectively. In the Neyman-Pearson set up the problem is to determine 
a critical region W such that 


(1) (60) = Pa (W) =) Lodz = a, an assigned value, and 
w 

(2) (01) = Pa (W) -| Lidz is maximum 
w 


compared to all other critical regions satisfying (1). If such a critical region exists 
it is called the most powerful critical region of level a. 

By the Neyman-Pearson lemma, the most powerful critical region Wo for tes- 
ting Ho : 0 = Oo against Hı : 0 = 0: is given by 


Wo = {a : Li > kLo} 


provided there exists a k such that (1) is satisfied. 

For this test y(09) = a and 7(6;) ~lasn— a. 

But for any good test we must have y(@)) — 0 and 7(@;) —> 1 as n > œ 
because complete discrimination between the hypotheses Hg and H, should be 
possible as the sample size becomes indefinitely large. 

Thus, for a good test it is required that the two error probabilities a and 8 
should depend on the sample size n and both should tend to zero as n — oo. 

We describe below test procedures which are optimum in the sense that they 
minimize the sum of the two error probabilities as compared to any other test. 
Note that minimizing (a + 8) is equivalent to maximising 


1—(a+f)=(1-8)—a= Power-Size. 


Thus, an optimum test maximises the difference of power and size as compared 
to any other test. 


Definition 1. A critical region Wọ will be called optimum if 


(3) f Lidz- | Lodz >f hdz- | Lodz, 
Wo Wo WwW W 


for every other critical region W. 
Lemma 1. For testing Ho : 0 = 0o against H, : 0 = 0, the region 
Wo = {x: Li > Lo} is optimum. 


Proof. Wo is such that inside Wọ, Lı > Lo and outside Wọ, Ly < Lo. Let W be 
any other critical region 


f (Li ore Lo)dz -f (Li i Lo)dz = T (Li aa Lo)dz -f (Lı = Lo)dz, 
Wo W Won Wwe wnWs 


by subtracting the integrals over the common region Wọ N W 
> 0 
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since the integrand of first integral is positive and the integrand under second 
integral is negative. Hence (3) is satisfied and Wo is an optimum critical region. 


Example 1. Consider a normal population N(6,07), where g? is known. It is 
desired to test Ho : 0 = 09 against Hı : 0 = 01, 0, > O%. 


1 n -ye 
L(x/0) = (=z) e i=l a 





_E(ei—01)? 

Li e 202 
E _ © (zi—80)? 

Lo e 202 


L 
The optimum test rejects Ho if r > 1, 
0 


L 
i.e., if log = > 0, 
0 





f PEDD C 01)? X (z: — Ao)? 

i.e., if — 552 952 = 0, 

i.e., if 201 X` x; — n0? — 2uo X` xi + n0? > 0, 
e., if (20, = 200) Yri > n(6? T Ge). 


of LH Atle 





+0 
ie, fra e. 


0+0 
Thus the optimum test rejects Ho if z > e - 


0+0 
We have a = Py, _ 2 = Pho 











Under Ho, follows N(0,1) distribution. 


a=1-9( LEW, 


20 


iia 


where ® is the c.d.f. of an N(0,1) distribution 


A] =n ek oge 





= Pa, |r < 
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Under H4, follows N(0, 1) distribution 


B=1-6 (E 


20 


ici 


Here a = 8. It can be seen that a = 8 — 0asn— oo. 


Example 2. For testing Ho : 0 = 0 against Ho : 6 = 01,0, < Oo, the optimum 


0+0 
test rejects Ho when © < ENE 


Example 3. Consider a normal distribution N (0, o°), 0 known. It is desired to 
test Ho : o°? = of against Hı : o° = 07, o? > og. We have 


1 2 (w,-0)? 
L(x/o?) = (sa) e re ae 











2707 
a 2 

a 2 : ae 
Li _ ot 
Lo ~ _ Eei? 

0 e 206 
Ly n 2 2 > (zi — 0) Di 0)? 

log A a (log aj — log ag) — 7E f 20? 

n 2 2 ye 0)? Jia 05 

= 5 (log oj — log ag) — 5 ee: 


L 
The optimum test rejects Ho if = >1 
0 





i.e., zi a a Dt ,- 6) 25 (logo? — log a4) 











i.e., > logo? — log o 
on a? — 2 ( 1 0) 
2 

i.e., if 5) ( ) > ne, 

00 

2 

where c = ——, (log o? — log 0) 

17 70 





2 
Thus the optimum test rejects Ho if > ( ) > nc. 
O0 
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Ti — 90 








SA 
Note that under Ho : follows N (0,1) distribution. Hence >> (z ) 


00 
follows under Ho, a chi-square distribution with n degrees of freedom (d.f.). Here 
i—90\" 

Z (2) zr 
00 


a= Pr =P [Xen > nc] 








and 


I 
= 





1-6 














|l 
= 
— 
2L 
Ze 
IV 


Ti — 





2 
Note that under Hy, >> ( z) follows a chi-square distribution with n d.f. 


It can be seen that a — 0 nae Oasn— œ. 

Example 4. Let X follow the exponential family distributions 
f(x/0) = (Oee OP) 

It is desired to test Ho : 0 = 0o against Hı : 0 = 0; 


L(x/8) = [e(0)] e2 OTe lI h(x) 


L 
The optimum test rejects Ho when log > >0 
0 











i.e., when [Q(61) — 4(0)] 2 t(2:) > nlog a 
n log ay 
i.e., when X` T(z;) > QON Q0] if Q(61) — Q0) > 0 
c(9o) 





and rejects Ho, when X` T(z;) < 


< gg E — 2Go)]_ i£ QO) — Q0) <0. 


Locally Optimum Tests 

Let the random variable X have the probability distribution P(x/0). We are 
interested in testing Ho : 0 = 09 against Hı : 0 > 09. If W is any critical region, 
then the power of the test as a function of 0 is 


(0) = PW) = | L(«/0)de. 


WwW 
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We want to determine a region W for which 


KOON = | 1(«/@)de — f L(2/0) 


w w 
is a maximum. 

When a uniformly optimum region does not exist, there is not a single region 
which is best for all alternatives. We may, however, find regions which are best for 
alternatives close to the null hypothesis and hope that such regions will also do 
well for distant alternatives. We shall call such regions locally optimum regions. 

Let y(@) admit Taylor expansion about the point 0 = 0). Then 


(6) = y(60) + (8 — 80)7'(80) +6 where 6 — 0 as 0 — 0o 
(O) — (90) = (8 — 90) Y (80) + 4. 
If |0 — | is small, y(@) — 7(@) is maximized when 7/(o) is maximized. 
Definition 2. A region Wọ will be called a locally optimum critical region if 
(4) 1 L'(x/09)dx >| L'(x/09)dx 
Wo W 
for every other critical region W. 


Lemma 2. Let Wo be the region {x : L'(x/09) > L(x/0o)}. Then Wo is locally 
optimum. 


Proof. Let Wọ be the region such that inside it L'(x/0o) > L(x/0o) and outside 
if L'(x/0o) < L(a/29). Let W be any other region. 
f L'(x/09)dx -f L'(x/0o)dz 
Wo W 
af L(x/Bo)ax — | L'(x/09)dx 
Won WE 


wenw 


G e f, gyal Gel Bohdn + f L'(w/0o)dx 


weuw 
> | eT E | naaid 
Wonwe weuw 
since L'(x/09)dx > L(x/0o) inside both the regions of the integrals. 
> 0, since L(x/0o) > 0 in all the regions. 


Hence | L'(x/09)dx >| L'(x/09)dx for every other region W. 
Wo W 


To prove (x) we have f Helo)dz +f L(x/0o)dx = 1 for every region R. 
R Re 


Differentiating, we have 


ip Dalene: [ LI(a/Bo)dx =0 


L'(x/0o)dx = — | L'(x/@)dx = 0. 
R Re 
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In (*), take R° = W N W and the relation is proved. 
Similarly, if the alternatives are Hı : 0 < 0 , the locally optimum critical 
region is 


{z : L'(x/60) < L(x/60)}. 


Example 5. Consider N(6,0*) distribution, o? known. It is desired to test 
Ho: 0 = 6 against Hı : 0 > 6o 


a e 
taje) = (=) eae 


ONV 2T 





log L(x/0) = n log (- 


L'(x/0) _ dlogL(z/0) Si(a,-0) n(¥-8) 
L 








(x/0) 60 g? o? 
L'(x/00) _ nŒ -= bo) 
L(a/6o) Ge ` 


The locally optimum test rejects Ho,if 


oO n 


Now, 


o2 
Qa = Pro ree + 7] 
n 








T -— bo 
= P > 
i a ave val 
= 1—ğ(o/yn), since under Ho, i follows N (0, 1) distribution. 


1—8 = Pp, [E > %+07/n] 
= Ez 0i — 9% A 





= Hı | 


ojm ofyn yn 


roo 





T-—0 
since under Hı, Z follows N (0, 1) distribution. 


o//n 


Exercise. If 6o = 10, 0; = 11, o = 2, n = 16, then a = 0.3085, 1 — 8 = 0.9337, 
Power-Size = 0.6252. 
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° > 1.64, then a = 0.05, 1— 8 = 0.6406, Power-Size 
n 


= 0.5906. Hence Power-Size of locally optimum test is greater than Power-size of 
the usual test. 





If we reject Ho when . 


Locally Optimum Unbiased Test 


Let the random variable X follows the probability distribution P(x/0). Suppose 
it is desired to test Ho : 0 = Oo against Hı : 6 # @. We impose the unbiasedness 
restriction 


(9) = y(9), 9 £ bo 


and y(@) — 7(6@9) is a maximum as compared to all other regions. If such a region 
does not exist, we impose the unbiasedness restriction y'(@)) = 0. 
Let y(@) admit Taylor expansion about the point 0 = 0). Then 


AO) = (85) + (0 — Ba)! (Bo) + PP 565) +n 
where 7 — 0 as 0 — 0. 
4(8) = Aleo) = (0 — Ba)! (fo) + PP (G4) +n 


Under the unbiasedness restriction y'(@)) = 0, if |@ — 6o| is small 7(@) — y(0o) is 
maximized when 7"(@9) is maximized. 


Definition 3. A region Wọ will be called a locally optimum unbiased region if 


(5) 4! (Oo) = l L(x/0))dx = 0 


(6) y” (0o) -f L" (X/09)dx > | L"(X/09)dx 
Wo w 
for all other regions W satisfying (5). 


Lemma 3. Let Wo be the region 
{x : L"(x/09) > L(x/6o)}. 


Then Wo is locally optimum unbiased. 
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Proof. Let W be any other region 
f Pajar = | L(x /o)dx 
Wo W 
= f AAA | L!" (a /0o)dx 
Won WE 


WonW 
by subtracting the common area of W and Wọ. 


= l AN f renidi 
Won Wwe WonwWwe 
since L”(x/0o) > L(x/0) inside Wo and outside W. 


> 0 since L(x/0) > 0. 


Example 6. Consider N (0,0?) distribution, a? known. 


Ho : 0 = bo, Hı = 0 # o 


( 1 ) _E æi)? 
L = — e 202 
OV 2T 


L"(x/0 mE- n 





L(x/@) gt Erz 
Locally optimum unbiased test rejects Ho 


n? (T T bo)? 
4 


= 2 2 
n(T — bo) sis 
g? > n 


if 








n ; 
ape oes 
o o 


(T — A)? 


Under Ho, 2 5 follows Xt) distribution. 
o 


Testing Mean of a normal population when variance is unknown 


Consider N(6,07) distribution, o? known. For testing Hp : 6 = 09 against 
H; : 0 = 464, the critical function of the optimum test is given by 


1 if L(x/0,) > L(x/6) 


0 otherwise. 


bm(x) = 


On simplification, we get 


Oo + 01 








1 ifT> if u > 
Pml) =. H£ Z H Hi Ho 
0 otherwise. 
n MOGI 
1 if> f u < 
Pml) a H£ Z H Hi Ho 


0 otherwise. 
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Consider the case when o? is unknown. 

For this case we propose a test which rejects Hyp when 
i 
Pef) 
L(x/0o) 


where L(x/0;), (i = 0,1), is the maximum of the likelihood under H; obtained 
from L(x/6;) by replacing o? by its maximum likelihood estimate 





n 


Let p(x) denote the critical function of the proposed test, then 
1 if L(x/0,) > E(£/0o) 
p(x) = : 
0 otherwise 


On simplification, we get 








o oto. 
1 Abe if u > Ho 
p(x) = 
0 otherwise. 
cous oto. 
1 ih if fy <u 
p(x) = : i 


0 otherwise. 


Thus, the proposed test ¢,(x) is equivalent to m(x), which is the optimum test 
that minimizes the sum of two error probabilities (a + 8). Thus, we see that 
one gets the same test which minimizes the sum of the two error probabilities 
irrespective of whether o? is known or unknown. 


Acknowledgement. Authors are thankful to Prof. Jokhan Singh for his gui- 
dance in writing this article. 


References 
[1] PANDEY, M. and SINGH, J., A note on testing mean of a normal population 
when variance is unknown, J.I.S.A., 16 (1978), 145-146. 


[2] PRADHAN, M., On testing a simple hypothesis against a simple alterna- 
tive making the sum of the probabilities of two errors minimum, J.I.S.A., 6 
(1968), 149-159. 


[3] Rao, C.R., Linear Statistical Inference and its Applications, John Wiley 
and Sons, 1973. 


[4] SINGH, J., Optimum Statistical Test Procedures, Vikram Mathematical Jour- 
nal, vol. V (1985), 53-56. 


Accepted: 18.07.2008 


